A gradient method with inexact oracle for composite nonconvex optimization

نویسندگان

چکیده

In this paper, we develop new first-order method for composite non-convex minimization problems with simple constraints and inexact oracle. The objective function is given as a sum of `hard', possibly part, `simple' convex part. Informally speaking, oracle inexactness means that, the `hard' at any point can approximately calculate value construct quadratic function, which bounds from above. We give several examples such inexactness: smooth functions Holder-continuous gradient, by auxiliary uniformly concave maximization problem, be solved only approximately. For introduced class problems, propose gradient-type method, allows to use different proximal setup adapt geometry feasible set, adaptively chooses controlled error, mapping. provide convergence rate our in terms norm generalized gradient mapping show case universal respect Holder parameters problem. Finally, particular case, that small necessary condition local minimum holds point.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Inexact proximal stochastic gradient method for convex composite optimization

We study an inexact proximal stochastic gradient (IPSG) method for convex composite optimization, whose objective function is a summation of an average of a large number of smooth convex functions and a convex, but possibly nonsmooth, function. Variance reduction techniques are incorporated in the method to reduce the stochastic gradient variance. The main feature of this IPSG algorithm is to a...

متن کامل

Inexact projected gradient method for vector optimization

In this work, we propose an inexact projected gradient-like method for solving smooth constrained vector optimization problems. In the unconstrained case, we retrieve the steepest descent method introduced by Graña Drummond and Svaiter. In the constrained setting, the method we present extends the exact one proposed by Graña Drummond and Iusem, since it admits relative errors on the search dire...

متن کامل

An inexact Newton method for nonconvex equality constrained optimization

We present a matrix-free line search algorithm for large-scale equality constrained optimization that allows for inexact step computations. For strictly convex problems, the method reduces to the inexact sequential quadratic programming approach proposed by Byrd et al. [SIAM J. Optim. 19(1) 351–369, 2008]. For nonconvex problems, the methodology developed in this paper allows for the presence o...

متن کامل

Intermediate Gradient Methods for Smooth Convex Problems with Inexact Oracle

Between the robust but slow (primal or dual) gradient methods and the fast but sensitive to errors fast gradient methods, our goal in this paper is to develop first-order methods for smooth convex problems with intermediate speed and intermediate sensitivity to errors. We develop a general family of first-order methods, the Intermediate Gradient Method (IGM), based on two sequences of coefficie...

متن کامل

Spectral Projected Gradient Method with Inexact Restoration for Minimization with Nonconvex Constraints

This work takes advantage of the spectral projected gradient direction within the inexact restoration framework to address nonlinear optimization problems with nonconvex constraints. The proposed strategy includes a convenient handling of the constraints, together with nonmonotonic features to speed up convergence. The numerical performance is assessed by experiments with hard-spheres problems,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Komp?ûternye issledovaniâ i modelirovanie

سال: 2022

ISSN: ['2076-7633', '2077-6853']

DOI: https://doi.org/10.20537/2076-7633-2022-14-2-321-334